(Original): A method, comprising the step of: 
rping a set of images synchronously captured from a camera array into a common coordinate 
system of aVomposite image. 

2. YOriginal): The method according to claim 1 , wherein said step of warping comprises the 
step of: \ 

applying a trJmsformative equation to selected pixels of each image to transform the selected pixels 
from a coordinate systW of the image to said common coordinate system. 

3 . (Original) : The method according to claim 2 , wherein said transformative equation is at least 
one of a bilinear transformationVadial transformation, perspective transformation, and affine transformation. 

4. (Original): The method according to claim 1 , wherein said step of warping comprises the 
steps of: \ 

identifying a set of contiguous parches in each of said images; and 
warping each patch into said common coordinate system. 

5. (Original): The method accordingUo claim 4, wherein said step of identifying patches, 
comprises: \ 

identifying regions in each image having registration! points in common with said composite image. 
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6. (Original): The method according to claim 4, wherein said step of warping, includes the step 



of: 



combining patches from different images having a same set of registration points into a same 
corresponding location of said composite image. 



7 . (Original) : The method according to claim 6, wherein said step of combining comprises the 

step of: 

cross-fading patches from different 
corresponding location of said composite iniage 



images having a same set of registration points into a same 



8 . (Original) : The method accon ling to claim 6, wherein said step of combining includes at least 



one of cross-fading, blurring, averaging, and 
different images having a same set of registrati 
image. 



c ther image effects to seamlessly combine said patches from 
o i points into a same corresponding location of said composite 



9. (Original): The method according to claim 4, wherein said step of warping each patch 
comprises the step of: 

performing a transformation on each pitch to transform pixels of each respective patch from a 



coordinate system of the respective patch to saic 



common coordinate system. 



10. (Original): The method according to claim 9, wherein said step of performing a 
transformation comprises: 
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applying a predetermined bilinear transformation matrix to each patch, said predetermined bilinear 
transformation matrix representing an amount of warping required for each patch to transform each patch 
into said common coordinate system. 

1 1 . (Original) : The method according to claim 7, wherein said step of cross-fading comprises 
the steps of: 

varying a parameter of each pixel of a first patch from minimum value at a first boundary of said first 
patch to a maximum value at an opposite bouniary of said first patch; 

varying said parameter of each pixel of ajsecond patch from said maximum value at a boundary of 
said second patch corresponding to said first boundary to said minimum value at a boundary of said second 
patch corresponding to said opposite boundary; 

summing each of corresponding pixel values of each said first patch and said second patch; and 

placing the summed values in corresponding locations of said common coordinate system. 

1 2. (Original): The method according|to claim 1 1 , wherein said parameter is at least one of 
brightness, contrast, and intensity. 

13. (Original): The method according to claim 1 , further comprising the step of: 
repeating said step of warping for each set of images synchronously captured by said camera array, 

each set of images representing one frame in a video stream of said scene. 

14. (Original): The method according to blaim 1 , further comprising the steps of: 
selecting an area of interest from the composite image; and 
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outputting the selected area of interestjto a user. 

f 



15. (Original): The method accord 
step of displaying said area of interest from th 



ng to claim 14, wherein said step of outputting comprises the 
5 combined warped images. 



16. (Original): The method according to claim 14, wherein said step of selecting comprises: 
directing said area of interest to a predetermined area surrounding at least one of motion detected 

in said scene, audio sources detected within saic scene, and proximity of objects detected in said scene. 

1 7. (Withdrawn): A method of controlling a virtual camera having a view selected from an array 
of cameras, comprising the steps of: 

combining images from each of said caiAeras into a panoramic view; 
detecting motion in said panoramic viewj and 
directing a view of said virtual camera bJsed on said motion. 

18. (Withdrawn): The method accorc ing to claim 1 7, wherein: 
said method further comprises the step of: 
ranging objects in said panoramic view by fetereoscopically calculating a range of said objects; and 
said step of directing comprises directing a vijsw of said virtual camera based on the motion detected 

and a range of said objects. 



19. (Withdrawn): The method according to claim 1 8, wherein: 
said method further comprises the steps of: 
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retrieving audio inputs from a set of directive microphones, and 
determining a direction of said audio i nputs within said panoramic view; and 
said step of directing comprises directii g a view of said virtual camera based on at least one of said 
motion, a range of said objects, and a direction of said audio inputs. 



20. (Original): A camera array, comprising: 
a set of cameras mounted in an array; 
an image combining mechanism configured to combine at least two of images captured from said set 
of cameras into a composite image; 

a view selection device configured to se|ect a view from the composite image; and 

I 

an output mechanism configured to display the selected view. 



2 1 . (Original): The camera array according to claim 20, wherein: 
said image combining mechanism includes, 

a warping device configured to warp patchesk>f each image into a common coordinate system of said 



composite image, and 



a fading device configured to fade and combine patches having a same location in said composite 



image. 



22. (Original): The camera array according to claim 20, wherein said frame selection device 



includes: 



at least one of, 

a video motion detector configured to detect inotion in the composite image, 
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of said camera array to determine a range of ob; 



a sound detection device configured to determine a location of sound originating within said composite 
image, and 

a stereoscopic ranging mechanism configured to utilize at least two images from separate cameras 

ects in said composite image; and 
a detection mechanism configured to automatically detect any of a face, shape, color, and motion of 
a subject for inclusion in said selected frame based on at least one of ranging data from said stereoscopic 
ranging mechanism, location data from said sounq detection device, and motion detected by said video motion 
detector 

23. (Original): The camera array according to claim 21, wherein: 
said array of cameras are immovably mounted on a firm fixed base; and 
said warping device applies a pre-determined transformation to each of said patches. 

24. (Original): The camera array according to claim 21, further comprising a registration 



mechanism configured to register each of said cairn 
views of each camera and said composite image. 



ra arrays by finding registration points in common with 



25. (Original): The camera array according to claim 24, wherein said registration device 
comprises: 

a registration point source directable to locations within each camera view; and 
a detection mechanism configured to detect said registration point source and register the detected 

registration point source in each of said camera views with respect to a coordinate system of said composite 

image. 
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26. (Original): The camera array According to claim 25, wherein said registration point source 
is at least one of a light source directed into view of said camera array and a grid placed in view of said 
camera array. 

27. (Original): A method of registering a camera array, comprising the steps of: 
placing at least one registration point ii l a field of view of at least two cameras of said camera array; 
identifying a location of each registrat: on point in a field of view of each camera of said array; and 
maintaining information about each regktration point in relation to each camera such that images may 

be combined in relation to said registration points. 



of: 



28. (Original): The method according to claim 27, wherein said step placing comprises the steps 



sweeping an beam light source across a field of view of at least two cameras of said camera array. 



29. (Original): The method according to claim 27, wherein said step of placing comprises the 



step of: 



placing a grid of known location in a field 'of view in at least two cameras of said array. 



30. (Original): The method according to claim 27, wherein said step of maintaining information 
comprises the steps of: ] 

calculating a warped coordinate system for Jlacing pixels of said cameras; 

maintaining a table identifying pixels of said caLeras, an amount of fade, and a corresponding location 
in the warped coordinate system. 



t 



-8 



Attorney Docket No.: PX/99009 
lharris/fxpt/1 003/1 003.respA 



FXPL-01003USO 



